Feature analysis of sentence vectors by an image-generation model using Sentence-BERT
نویسندگان
چکیده
In this study, using k-means and UMAP, we verified that the sentence vectors generated by Sentence-BERT as distributed representations of sentences capture meaning well. To end, visualized generating images matching from Sentence-BERT. The results confirm although there were differences in information represented each dimension distributional features vector, overlapped substantially.
منابع مشابه
Integrated sentence generation using charts
1 [Adjr2, {r2}, {whiter2}] (whiter2) 2 [Adjr2,U, ∅] (nopr2) 3 [Nr2, {r2}, {whiter2, rabbit r2}] (rabbit r2, 1) 4 [Nr2, {r2}, {whiter2}] (thingr2, 1) 5 [Nr2, {r1, r2}, {rabbit r2}] (rabbit r2, 2) 6 [NPr2, {r2}, {whiter2, rabbit r2}] (ther2, 3) 7 [NPr2, {r2}, {whiter2}] (ther2, 4) 8 [NPr2, {r1, r2}, {rabbit r2}] (ther2, 5) 9 [Se, {e}, {whiter2, rabbit r2, sleepe,r2}] (sleepe,r2, 6) 10 [Se, {e}, {...
متن کاملSentence Generation by Semantic concordance
Generation of English sentence is realized in the following three steps. First, the generation of kernel sentence by phrase structure rules; second, the application of transformational rules to the kernel sentence; and finally the completion of a sentence by the morphophonemic modifications. At the first stage of generating kernel sentence, the semantics of words are fully utilized. The method ...
متن کاملA DNA assembly model of sentence generation
Recent results of corpus-based linguistics demonstrate that context-appropriate sentences can be generated by a stochastic constraint satisfaction process. Exploiting the similarity of constraint satisfaction and DNA self-assembly, we explore a DNA assembly model of sentence generation. The words and phrases in a language corpus are encoded as DNA molecules to build a language model of the corp...
متن کاملImproving Automatic Sentence-Level Annotation of Human Values Using Augmented Feature Vectors
This paper describes an effort to improve identification of human values that are directly or indirectly invoked within the prepared statements of witnesses before legislative and regulatory hearings. We automatically code human values at the sentence level using supervised machine learning techniques trained on a few thousand annotated sentences. To simulate an actual situation, we treat a qua...
متن کاملSentence diagram generation using dependency parsing
Dependency parsers show syntactic relations between words using a directed graph, but comparing dependency parsers is difficult because of differences in theoretical models. We describe a system to convert dependency models to a structural grammar used in grammar education. Doing so highlights features that are potentially overlooked in the dependency graph, as well as exposing potential weakne...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Nonlinear Theory and Its Applications, IEICE
سال: 2023
ISSN: ['2185-4106']
DOI: https://doi.org/10.1587/nolta.14.508